Generalized relation between the relative entropy and dissipation for nonequilibrium systems 
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Recently, Kawai, Parrondo, and Van den Broeck have related dissipation to time-reversal asymmetry. We 
generalized the result by considering a protocol where the physical system is driven away from an initial thermal 
equilibrium state with temperature /?o to a final thermal equilibrium state at a different temperature. We illustrate 
the result using a model with an exact solution, i.e., a particle in a moving one-dimensional harmonic well. 
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I. INTRODUCTION 

Irreversible thermodynamic processes are the ones that can- 
not be closed. In other words, the system and its surroundings 
never return to their original states. There are a number of 
features associated with such processes which include (i) dis- 
sipation; (ii) asymmetry in the arrow of time; and (iii) bro- 
ken equilibrium. In recent years, some relations have been 
stated between dissipation and time-reversal asymmetry JT]- 
[Toll . Here, we will focus on the relation obtained by Kawai, 
Parrondo, and Van den Broeck (KPV), which is expressed by 
the following @], 



P(W diss )>D[p F (z,t) \\p R (z*,T-t)}. 



(1) 



In this relation, (W^ ISS ) is the average work dissipated during 
the process in which the system evolved from one canonical 
equilibrium state at a temperature T into another at the same 
temperature. Based on the second law, the average work per- 
formed on the system must exceed the difference between the 
free energy in the initial equilibrium state and that in the final 
equilibrium one, i.e. (W) > AF = Fb — F^ [11]. The dissi- 
pated work is defined as (Wj, sv ) = (W) - AF. D(p F (z,t) \\ 
Pr{z* ,1 — t)) denotes the relative entropy lll2ll . a measure of 
the distinction between p F , i.e. the time-dependent phase- 
space density, during the forward process (A — > B) and Pr, i.e. 
the time-dependent phase-space one, during the reverse pro- 
cess (B — > A). z= (x, p) designates a point in the phase space, 
and the asterisk denotes the reversal of momenta, p — > —p. 
For the case of the Hamiltonian dynamics, where the system 
evolves deterministically, Eq. (1) is an equality; i.e., the aver- 
age dissipated work can be expressed by J3l, 



P(W diss ) = dzp F {z,t)\n 



p fi ( Z *,T-f) J 

D[p F (z,t) || p R (z*,T-t)}. 



(2) 



Consider a system that is driven far from equilibrium by a 
protocol, where the inverse temperature of the initial and final 
equilibrium states are /3o and p\, respectively. Our goal is to 
generalize Eq. (2) to this kind of process. A basic motivation 
to study this generalized relation is its possible application to 
the evolution of black holes that we will discuss elsewhere. 



This will be attempted in Sec. 2. In Sec. 3, we will consider 
two solvable models for the generalized equation. 



II. GENERALIZATION OF KPV EQUATION 

We consider a system that is initially coupled with a reser- 
voir in the reverse temperature pV The reservoir is then re- 
moved. Subsequently, from t = to a later time t — T, the ex- 
ternal forces are turned on according to some arbitrary but pre- 
determined schedule, or protocol, A,. The microscopic evolu- 
tion of the system during this time interval is described by 
the trajectory Zt — (p,q)- The Hamiltonian of the system is 
denoted by H(X t ,z t ). At time t = T, the system is coupled 
with a reservoir in the reverse temperature p\, again. Simi- 
lar to the derivation of the Crooks equality Q], we consider 
two processes which are labeled forward (F) and reverse (R). 
The initial phase-space densities for the forward and reverse 
processes are given by (/ = F or R) 



Pofe>,Ao) = — exp[-pV/(zo,Ao)], 
A) 



(3) 



and Zt = J dztexp[—l5 t H(zt,Xt)} is partition function at time 
t = or t = T. It should be noted that temperature is only 
defined for the initial and final states and not for any state 
between the two. By combining Eq. (0 and definition of the 
partition function, we get 

4 = ^«p[&/f(zg; A,) "ftfffco ;*>)]• W 

P() M) 

According to the definition of free energy given by F{Xt) = 
— j8 f 1 lnZ(A,), Eq. dUi can be rewritten as follows: 



% =exp[-A(j3F)]exp[j3 T //(4;A T )-/3oH^;Ao)]. (5) 
Po 

Note that A(fiF) = $ Z F Z — PqFq. Assume that the work per- 
formed on the system is defined by 171, 1131 - 1 1511 
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f T ■ dH 

W[Zt] = J Q dtX — ( Zt ,Xr)- 

Then, based on this definition, we have [7] 
W[ Zt ] =H{z F x ;X x )-H{z F -M. 



(6) 



(7) 
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Using Eq. 0, Eq. (0 can be simplified as 

% = exp[-A(PF) + frW + (p t -Po)H ], (8) 
Po 

where Hq = H(z F ;Xo). We can rewrite Eq. (0 as 

ln(^) = -A(j3F)+j3 T W + (j3 T -j3 )// . (9) 
Po 

We can use the definition of average as, J dzoPo{zo)A =< 



A > 



where, A is an arbitrary normalized function 



[/ dzoA(zo,0) = 1]. Therefore, we can write equality (0 as 



-A(j8F) + p T (W) pS + (ft - ft) (H )pF . 



(10) 



By performing an average over the different subsets, we will 
have 

(ftW + (ft-ft)// ) F = E f ,p„ f (j3 T W + (j3 T -j3o)H )^. 

(16) 

Finally, considering Eqs. < TT3T > and ([T6l i yields the following 
generalized relations: 

(ftW + (ft-ft)// ) F -A(/3F) > fH^)dp F n Ml) 

* Pn 

(ftW + (ft-j3 o )// o } F -A03F) > D(p*\\p*). (18) 

Equation (fT8l is the basic result of this Brief Report. In Sec. 
3, we will consider an example that corresponds to an exact 
equality as in Eq. (fT2l . 



Since the phase-space density is conserved along any Hamil- 
tonian trajectory, i.e., p F — p F and p$ — p R and based on the 
definition of the relative entropy 



/ 



dzpF{z,t)\n\ 



PF(z,t) 
p R {z*,T-t) 



-D[p F (z,t) \\p R (z*,T-t)}, 



(ID 



we obtain the following generalized form of Eq. 0: 



D(P F || P R ) = -A(J3F) + J 8 t (W>^ + (J3 t -A))<Ho> p f.(12) 

The above expression is valid for the deterministic trajecto- 
ries of the system, including information about every degree 
of freedom. If only partial information about the system is 
available, the relative entropy is reduced and we will have an 
inequality. 

Since z = (q,p) in deterministic dynamics represents all po- 
sition and momentum variables and, p(q,p) surrounds the 
phase-space trajectory going through z — (q,p), Therefore, we 
can consider a partition of the entire phase space j5[].This par- 
tition is described by a sequence zq,Zi,-.-Z„- Corresponding 
phase space distributions for the forward and backward pro- 
cesses are given by 

Pn = / Po(p,q)dqdp, p„ ff = l p§(p,q)dqdp. (13) 

By integrating Eq. (0 over z„ we obtain 

(exp[-/3 T W-(/3 T -j3 )Ho])^ = 

4 p F {p,q)ex V (-p x W - (p\ - Po)H )dqdp 



Pn 



Pi 
Pi 



exp[-A(/3F)] 



(14) 



Now, by using (exp(— x)) > exp(— x), we can rewrite Eq. (fT4l 



(j3 T W + (j3 T -j3 )// )^>A(j3F) + ln^. (15) 

Pn 



III. PARTICLE IN A MOVING HARMONIC WELL 

In this section, we analyze Eq. (fT2l for a particle with mass 
m which is trapped in a harmonic well with a spring constant 
k. The Hamiltonian of the particle is given by 



(19) 



We will consider processes during which the center of the well 
is moved either rightward or leftward at a constant speed, 
//. These correspond to the forward and reverse protocols, 
Xf (f) = ut and A/j(f) = k(t — t), where T is the total time in- 
terval. Along this time interval, the initial and final reverse 
temperatures are p\j and j3 T , respectively, during the forward 
process, and vice versa during the reverse process. We con- 
sider two dynamics for this example: Hamiltonian dynamics 
and Langevin dynamics. 



A. Hamiltonian dynamics 

In this section we assume that the system is thermally iso- 
lated from environment after the initial equilibration stage. 
Explicit expressions for the initial equilibrium densities are 
given by the following Gaussian distributions: 



Ik V m 2m 2 



(20) 



^ k 



- lv^ exp[ -^ ( £ + i^- MT ) 2 )]- (2i) 

By considering that in this situation the system evolves under 
the Hamiltonian dynamics, the equations of motions are given 
by 



Xf 



EL 

m 
PR 



p'p = —k[xF — ut). 



(22) 



xr = — , pn — —k(xR~uT + ut). (23) 
m 
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Due to the Gaussian nature of the initial densities [Eqs. 
( l20t and (|2TT i1 and the linearity of the equations of mo- 
tion, the distribution remains Gaussian for all times. There- 
fore, according to the relations of means and covari- 
ances for two-dimensional Gaussian distributions, (/g(z) = 
— -k — exp\\(z-z) T .<J- l .(z-z)}), and consider that the 

27i\Jdeto v 1 

relative entropy between two Gaussian distributions, /g{z) 
and g G {z*), is 

D[f G (z)\\8G(z)} = -l + 1 -[H^) + Tr(a- l .a})} 



Therefore, comparison of Eqs. d25l l and ( f29T > yields the fol- 
lowing equation for a Hamiltonian dynamics: 



MW) p f + (P,-I3o){Ho) p f-A(PF) 
D[p F (z,t) || p R (z*,T-t)}, 

which is a special case of Eq. ( [T2l >. 

B. Overdamped Langevin dynamics 



(30) 



+ -(i}-z g y .0^.(1} -i g ) 



(24) 



where a* p = —O xp and all other elements of <7* are unaltered 
10. We have 

D\p P {z,t)\\p R {z\T-t)] = + + 

Pt Po 

+ P T mu 2 [l -cos(wt)]. (25) 

By considering the relations for means and variances that we 
obtain here, we can say that the means and variances are the 
same with the results in Ref. 01; the only difference is that 
here we have j8o in t = and p\ in t = T. Also, according to 
the following relations 



— uk J [xf(t) — ut] 

Jo w 
mu 2 [l — cos(wt)], 



-[A(/3F)]=ln( 



pY 



The left-hand side of Eq. ( fT2b is equal to 



/W[l - cos(wt)] + {Pt-M^+Hw) 

Po Pt 



(26) 



(27) 



(28) 



So, we have 



P\ (W) p f + (p\ - Po) (H ) P f - A(J3F) = 



Po 



(j3 T - ft) 1 + ln( §° ) + p> M 2 [1 - cos(wt)] . (29) 

PO Pt 

I 



In this section we consider a system that interacts with 
its environment so that we may use overdamped Langevin 
dynamics0]. For the forward process the Fokker-Planck 
equation for p F (x,t) is 

§- t PF(x,t) = ~[(x-ut)p P (x,t)] + ^-^p F (x,t). (31) 

where y is the friction coefficient. By the use of the means 
and variances for forward and reverse processes, 



oi = 



l 

ft*' 



(32) 



XR 



W = M(T _, ) + ^ (1 _ e -^)/r )j a | = _i_ 5 (33) 



we have the following results for the relative entropy and av- 
erage work: 

D[p F (x,t)\\p R (x,T-t)} = -l+H^) + fe) 

Pt Po 



2j3 T yV 



{1 



*tocaA[±£-t)]}* 



(34) 



-uk 



( [x F {t)- 
Jo 



ut\ 



y u 2 [T _l i l_ e -kx/r j ^ (35) 



In this situation, we have to demonstrate the validity of in- 
equality ( fT8l ). We note that the left-hand side of this inequality 



(PtW + (p\ - Po)H ) F AQ3F) = Pt7« 2 [t- |(1 - e^)} + Q3 T _ ft ) J_ +ln(^), 

£ Po Pt 



(36) 



and Z)(p,f || p,f ) has a maximum value at t = t/2. Combining where the inequality is valid for any £ = ^ > 0. Therefore the 



Eqs. d34l > and d36i > we have 

(P T W + (P Z -P Q )H Q ) F -A(PF) > D(fiU\Pn) 



validity of inequality ( TT8l for overdamped Langevin dynamics 
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is demonstrated. 



IV. CONCLUSION 

We extended a known relation between the dissipated work 
and time-reversal asymmetry to a more general case by as- 
suming a protocol which starts from an equilibrium state and 
moves to another equilibrium where the initial and final tem- 



peratures are different (it should be noted that we do not need 
to define temperatures between the two equilibria). Time- 
reversal asymmetry is more clear in this kind of process; how- 
ever, the definition of dissipated work is not completely un- 
derstood in this situation. It will be interesting to consider 
more general cases, as they will provide a better understand- 
ing of the relationship between the time-reversal asymmetry 
and dissipation and other aspects of non-equilibrium statisti- 
cal mechanics. 
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